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1. INTRODUCTION 

In recent years, the PHP programming language has evolved as the scripting language of choice by 
most developers; there has been an explosion of upcoming PHP frameworks. These framewoorks for PHP 
development have multiple benefits, and are one of the most important developments in the design and IT 
development practices of the last 20 years. There are several reasons why a developer would like to choose 
PHP frameworks, especially because they offer developers the ability to create more complex, secure and 
complete web applications faster than ever before. Thanks to their convenient file structure, they make it 
possible to organize the files and the code of the developer and to increase its productivity. PHP frameworks 
are available in all kinds of shapes and sizes and have targeted developers with different levels of experience, 
application needs, hosting capabilities and development time. 

The authors [1] declare that the PHP framework facilitates Web programming and makes it better 
organized in several ways. First, PHP frameworks increase the productivity of programming because writing 
a piece of code that usually takes hours and takes hundreds of lines of code can be done in minutes using 
built-in functions of the framework. On the other hand, a PHP framework usually comes with a support team, 
documentation or important support forums where users can quickly get answers.The authors [2] emphasize 
the importance of using PHP frameworks; they propose a modular workspace, consisting of a set of libraries, 
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tools and conventions that allow focusing on the business logic of the 'application. It also provides a 
framework for the application, usually based on the use of the Model View Controller (MVC) paradigm. This 
ensures a separation between: the data model that is in charge of access and requests to the database, the 
"view", which is a description of the presentation of the data (eg: generation of HTML, XML, JSON, etc.), 
and the controller, which implements the business logic by retrieving the model data to make them available 
to view [3].The authors [4], [5] argue that PHP frameworks have a major security advantage since its users 
become long-term testers. If a user finds a security issue, they can notify the infrastructure developer website 
so that the development team can fix it [6]. Thus the authors [7] declare that PHP frameworks have features 
that satisfy most web programmers depending on the development style they want. Actually, there are PHP 
frameworks with all kinds of features such as security, robustness, ease of use. 

However, choosing a PHP framework introduces many requirements and complexity, as some 
development habits will have to be set aside when it is adopted. Thus, although it is supposed to improve the 
productivity of the user's developments, there is always a phase during which the cost is greater than the gain: 
this choice must be carefully considered. 

To this end, our contribution in this article is to propose a new complete model, which gathers a set 
of comparison criteria dedicated to PHP frameworks, in order to facilitate the developer's choice of his 
suitable framework, since there are no methods comparison and comprehensive assessments. The reminder of 
this paper is as follow: section 2 presents a literature review about the subject, then we present trough section 
3 our proposed model dedicated to the evaluation of web development frameworks. Section 4 presents a 
discussion of the obtained results, to sum up with a conclusion in section 5. 


2. LITERATURE REVIEW 

Choosing a framework for a given project can be quite complicated when we do not know all the 
modern PHP frameworks that are most used, and more particularly their differences. Beyond the technical 
considerations when choosing a framework, it is essential to assess the risks presented by each of the selected 
solutions. Since the framework must eventually form the basis of the majority of developments made for the 
company, it is important that its durability be ensured: its development must be sufficiently dynamic, in order 
to limit the risks of abandonment or closure of the code. The QSOS method (Qualification and Selection of 
Open Source Software) has been proposed to evaluate these risks. 

The QSOS method (Qualification and Selection of Opensource Software) was initiated by Raphaël 
Semeteys and developed by Atos Origin [8]. Was designed to evaluate Free Software and OpenSource 
objectively, the objective was to design and make available: an evaluation methodology, tools related to it 
and especially a repository of assessments carried out. Who says referential, says obligation to define a set of 
common criteria for each functional area and to evaluate each free software with regard to these. The 
proposed approach also includes a notion of weighting to adapt the evaluation grid and the rating. Obtained 
by the software to its particular context [9] [10]. QSOS is an iterative process divided into four stages. Here 
are these different steps: 

a. Define: the repository data (types of licenses, types of communities, functional coverage grids by 
domain). 

b. Evaluate : software according to three main axes : functional coverage, risks from the point of view of the 
user company, risks from the point of view of the service provider (expertise, training, support). Each axis 
consists of a number criteria. For example, the risk axis undertaken includes: intrinsic sustainability, 
integration, technical adaptability, level of industrialization and project strategy. These criteria are 
themselves composed of sub-criteria. 

c. Qualify: the specific context of a company (or a user) by weighting the previous criteria. 

d. Select: and compare software that meets the needs. 

To better understand this process, Figure 1 illustrates QSOS methodology [9]. There is another 
method of evaluation that only concerns PHP frameworks. This method was created by the company 
SMILE [11], [12]. This company has created a book about frameworks, then it used comparison criteria to 
evaluate them: 

PHP Version, Architecture Model, ORM, Templates, Cache, Friendly URLs, Validation Forms, 
Ajax, Extensions, Code Generation, Internationalization I18n, Recommendation. What is important is the 
ease of use of each framework, as well as the tools it offers. The more tools a framework offers for 
development, the faster the implementation phase of an application is. If we take for example the criterion 
"Automated unit tests", the framework offering this tool avoids the application developer having to spend 
time testing his entire application. When a report is generated automatically, it will be faster to know where 
the application's errors are. We also need a criterion concerning the learning of the framework. 
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The QSOS method is characterized by the evaluation of any open source software, is not dedicated 
specifically to the PHP framework. On the other hand, the method of criterion of the frameworks of the 
company SMILE concerns only the evaluation of PHP frameworks, but it does not use sufficient and global 
criteria of comparisons. For that aim, we propose a pragmatic and complete model to compare and evaluate 
the main PHP frameworks. We have focused on the main criteria for the selectionof a framework that can 
differentiate a good from a less good framework, and we provide a quick summary of the reasons that push to 
use or not a framework in general, depends on the needs of the user. 
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Figure 1. QSOS process 


3. PROPOSED MODEL 

In order to provide a holistic approach for the comparison of web development frameworks to be 
used by IT project developers, we provide a new model that combines six dimensions: Intrinsic durability, 
the industrialized solutions proposed by each framework, technical adaptability, the strategy, the technical 
architecture and finally, the speed, efficiency and economy of resources. 

We present below our proposed model, for more understanding, we have selected 4 PHP 
frameworks, that are most used in web development these last years (Laravel, Symfony, Zend and 
Codeigniter). For each criterion, the scoring rule is: 

a. 0 if the feature is not covered. 
b. 1 if the feature is partially covered. 
c. 2 if the feature is fully covered. 


3.1. Intrinsic durability 

Beyond the technical considerations that come when choosing a framework, it is essential to 
evaluate the risks presented by each of the solutions chosen. Thus, it is important that its durability be 
ensured: its development must be sufficiently dynamic, in order to limit the risks of abandonment or closure 
of the code. Table 1 presents the intrinsic durability comparison of the selected PHP frameworks. 
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Table 1. Intrinsic Durability Comparison 
Intrinsic durability Laravel [13] Symfony[14] Zend [15] Code Igniter[16] 
Maturity 
Age 1 1 1 1 
release date : 2011 release date : December 2005 release date : 2007 release date : 2006 
Stability : = + 2. 
stable version : 5.4.27 stable version 3.3.9 stable version 3.0 stable version 3.1.6 
History, known 2 2 2 2 
eke a bug history is available on the site [13] [16] 
Probability or 1 1 2 0 
provenance of a Laravel is Symfony's Fork Symfony is a FORK of 
FORK Mojavi2 
Adoption 
Popularity 2 2 2 2 
References 2 2 2 1 
Many references (Amazon, Many references (Yahoo!, Many references (IBM, some references whose 
etc) etc.). cf. http:// Nokia, etc.). cf. http:// Emmaus.uk 
symfonians.net/ applications/ framework.zend.c 
om/community/ 
applications/ 
Community of 2 2 2 2 


contributors the community is active on the community is important the community is the community is active 
dedicated forums, blogs and and active on the dedicated important and active on on the dedicated forums 
Google Groups forums, blogs and Google dedicated forums and 
Groups blogs 
Publication 1 1 1 1 
publication of English books publication of English parution de livresen publication of a book in 


« larevel 5.x cookbook »and 
« larevel essentials » etc. 


books « The Definitive 
Guide to Symfony » and 
« Develop your website 


anglais 


« Architect's Guide to 
Programming with Zend 


English « professionel 
codigniter » 
and « Codeigniter for 


with Framework symfony Framework » and Rapid Php Application 
3» ete. « Zend Framework in Development»etc. 
action » etc. 
Direction of developments 
Leading team 2 2 2 2 
Laravel management team Fabien Potencier of Sensio management team from EllisLab management 
Labs Zend Technologies team 
Direction mode 2 1 2 1 
a person a person group of people a person 
Activity 
Number of 2 2 2 2 
developers, a dozen people fifty people fifty people Ten people 
identification, 
turnover 
Activity around 2 2 2 2 
bugs bug tracking is available via responsive forum and bug tracking of available bugs bug tracking accessible 
github laravel tracking available viaa through a dedicated wiki via the page 
symfony trac BugTracker 
Activities around 2 2 2 2 


features 


a section of the forum is 
devoted to the demand for 
new features 


a section of the forum is 
devoted to the demand for 
new features 


for new features 


an IssueTracker page is a section of the forum is 
dedicated to the demand devoted to the demand 


for new features 


Activities on 2 2 2 2 
releases 

Independence of developments 

Independence of 1 1 1 1 
developments 


3.2. Industrialized solution 

Several constants must be taken into account before starting an industrialization developments based 
on web development frameworks: the mode of operation of the development, infrastructure and maintenance 
teams, the current and future functional requirements, the constraints of the hosting platform. We present 
trough Table 2, a comparison of the selected frameworks based on industrialized solution criterions. 
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Table 2. Industrialized Solution Compariso 


Industrialized Solution 


Laravel 


Symfony Zend Framework 


Code Igniter 


Services 


Training 


Support 


Documentation 
Documentation 
Quality method 
Quality assurance 
Tools 
Packaging 
Source 
Debian 
FreeBSD 
HP-UX 
Mac OS X 
Mandriva 
NetBSD 
OpenBSD 
RedHat/Fedora 
Solaris 
SuSE 
Windows 
Operability 
Ease of use, 
ergonomics 


Administration / 
Supervision 


2 
Fabien Le corre and 
Steven Sil are for 
example providers 
offering training 
laravel 


2 
several existing 
offers forums, 
mailing lists and 
Google Groups, 
tutorials etc. 


y ee eo dO RA 


2 2 
Anaska, Sqli or Zend and Anaska 
Clever Age are for for example, are 
example providers providers offering 


offering Symfony training at Zend 
training Framework 
2 1 
several existing offers Zend Technologies 


(Clever Age, Sensio, 


etc.), forums, mailing framework via its 


lists and Google network 

Groups,, tutorials 
2 2 
2 2 
2 2 
2 1 
2 2 
1 1 
1 1 
1 1 
1 1 
1 1 
1 1 
1 1 
1 1 
1 1 
1 1 
2 2 
2 2 


offers support for this 


2 
Jérôme Megel 
is for example 
offers a codeigniter 
training 


1 
provides 
support for this 
framework via 
forums, 
tutorials 


= m ee ee No 


3.3. Technical Adaptability 


The selected frameworks should be compared according to the technical adaptability characteristics. 


Table 3 depicts the results of the comparison. 


Table 3. Technical Adabtability Comparison 


Technical Adaptability Laravel Symfony Zend Framework Code Igniter 
Modularity 
Modularité 2 2 2 2 
plugins extensions 
Derivative works 
Technical ease of modification 2 2 1 2 
of the existing code 
Easy code extension 2 2 2 2 
ability to use possibility to use possibility to possibility to 
components, templates additional plugins use extensions add plugins 


and plugins additional 


3.4. Strategy 


The strategic dimension is very important in the selection of information systems development 
frameworks. Thus, we present trough Table 4, the comparison between the selected PHP frameworks based 


on the strategic features. 
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Strategy Laravel Symfony Zend Framework Code Igniter 
Licence 
Permissiveness 2 2 2 2 
Licence MIT Licence MIT Licence BSD Licence MIT 
Rights holders 
Roadmap 1 1 1 1 
Sponsor 
1 1 1 1 
Sponsor Sole sponsor: Taylor Sole sponsor : Sensio Sole sponsor : Zend Sole sponsor : 
Otwell. Labs technologies EllisLabs 
Strategic independence 
Strategic independence 1 1 1 1 


3.5. Technical Architecture 
We present trough Table 5 the technical architecture criteria for the assessment of the frameworks. 


Table 5. Comparison of the Technical Architecture 


Laravel Symfony Zend Codeigniter 
PHP version 5 5 5 4/5 
Documentation 2 3 1 2 
Community 3 3 3 3 
Tutorials 3 3 3 2 
Automated unit tests yes yes yes yes 
Rights management yes yes yes yes 
Architecture model MVC MVC MVC MVC 
Integrated ORM Eloquent Doctrine or Propel Doctrine Doctrine 
Template blade PHP or smarty PHP PHP 
Size of tool library 3 3 3 2 
AJAX yes yes No No 
code generator yes yes No No 


3.6. Speed Comparison 

The selection of web development framework is largely geared towards the execution speed of the 
framework. As such, the alternatives should be compared according to their speed to estimate the speed of 
development of the project to the use of a framwork. High speed allows developers to save time developing 
applications. 


4. RESULTS AND DISCUSSIONS 

Selecting a Web development framework is not an easy task, since this choice involves quite a 
variety of issues: internal design of the framework, ease of use, technical qualities, future evolution, etc. But, 
beyond the simple qualities of the frameworks compared in this paper, several constants must be taken into 
account before starting to develop by one of these frameworks: the mode of operation, development teams, 
infrastructure and maintenance, the current and future functional requirements, and the constraints of the 
hosting platform. In any case, the choice of a development framework can only improve the quality of an 
existing which, without procedures, conventions or standards, is rarely well designed. It remains to determine 
what the framework that best suits your needs and your context is. 

This section aims to analyze the different frameworks cited in this paper. It should be noted that the 
information gathered through the analysis is mainly statistical. We present trough Table 6 the representation 
in tabular form, expressed as a percentage of the maximum achievable score, the distribution of the notes of 
these four frameworks according to the main categories analyzed. Then we provide a representation in the 
form of a histogram graph trough Figure 2: 


Table 6. Summary Table of these Main Categories of the QSOS Method 


Laravel Symfony Zend Codeigniter 
Perenity 83,33% 83,33% 86,66% 76,66% 
Industrialised solution 73,68% 73,68% 68.42% 63,15% 
Adaptability 100% 100% 83,33% 100% 
Strategy 70% 70% 60% 60% 
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Figure 2. Histogram' summary chart 


The purpose of Table 7 is to be able to define a selection of the most interesting frameworks with 
which we will make an example application to really see the differences in practice. Here is the comparison 
chart: 


Table 7. Comparative of the Selected Frameworks [12]-[16],[17] 


Laravel Symfony Zend Codeigniter 
PHP version 5 5 5 4/5 
Documentation 2 3 1 2 
Community 3 3 3 3 
Tutorials 3 3 3 2 
Automated unit tests Yes yes yes yes 
Rights management Yes yes yes yes 
Architecture model MVC MVC MVC MVC 
Integrated ORM Eloquent Doctrine or Propel Doctrine Doctrine 
Template blade PHP or smarty PHP PHP 
Size of tool library 3 3 3 2 
AJAX Yes yes No No 
code generator Yes yes No No 


We present the Bar graph representation according to code generator, AJAX, MVC architecture 
model, rights management, automated unit testing criteria as shown in Figure 3. 
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Figure 3. The comparison between framework tools 
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Figure 4 presents the curved graphic representation according to the criteria: documentation, 
community, tutorials, tool library size. 


«— Documentation Community —*— Tutorials Size of the tool library 


Laravel Symfony Codelgniter 


Figure 4. Comparison between frameworks with different criteria 


These graphs allow to have an analysis of the selected frameworks. We notice that most frameworks 
have quite similar results. The next step consists of evaluating the frameworks according to speed criteria, 
efficiency and optimization of resources. For that aim, tests were done with these four frameworks on the 
same computer and taking the same actions. Apache Benchmark has been defined as a test tool. The 
computer on which the tests were performed has the following specifications: Intel Core i5, 8 GB DDR3, 
SATA3 SSD, Ubuntu 14.04 LTS, Apache 2.4, PHP 5.5. Figure 5 presents the number of queries that these 
compared frameworks could handle per second [12], [18]: 
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Figure 5. Comparison between the frameworks by the criterion of speed, efficiency and economy of 
resources 


Symfony 


Results show that CodeIgniter framework is slow and does not comply with current requirements. 
Thus, this tool is not worth learning at this stage. 

Laravel, Zend and Symfony are currently in compliance with modern standards and requirements. 
They are in demand and have huge features. For beginners, it will be easier to start with Laravel, rather than 
Symfony or Zend. 

Laravel can be used for the rapid development of large-scale applications, even with less 
experienced resources, but if it is a complex level application development, it would be preferably for 
developers to choose Symfony, but they need to be more experienced to develop with this framework. 
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Zend's development team includes PHP kernel developers and makes sure the framework is robust, 
complete and stable. On the other hand, Zend is one of the most difficult settings to learn and has a very steep 
learning curve. Further, the configuration options are huge and simply increase the complexity. 

It has for a very long time evolved very little: the community could hardly contribute to the 
framework, therefore version 2 had to correct that. Furthermore, it is very restrictive and also requires a long 
learning time. 

Finally, CodeIgniter framework is « light »: it leaves a lot of flexibility to the developer. This can be 
a weak point as a strong point. His grip is extremely fast (a few hours). And the community is becoming 
more available. In addition, we can find on Github dozens of libraries to handle all the classic needs of a 
developer. It is ideal for simple projects and short. 


5. CONCLUSION 

In this paper, we have proposed a new model for the full assessment of IT project development 
frameworks to be selected by developers. For this, we have proposed a set of criteria to be used in the 
selection phase, based on six dimensions: the intrinsic durability, industrialized solution, technical 
adaptability, strategy, technical architecture, and Speed criteria. 

For more understanding of our proposed model, we have applied our model, to set of 4 PHP 
frameworks that are the most used in these last years, and we provided a detailed analysis of this comparison. 
In perspective, the proposed model can be used as an AHP (Analytical Hierarchy Process) [19] hierachy to 
calculate the weight of each criteria depending on the decision makers. 
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